Pandas Profiling Report

Dataset statistics

Number of variables	15
Number of observations	5701
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	668.2 KiB
Average record size in memory	120.0 B

Variable types

Numeric	15

Alerts

`gross_revenue` is highly correlated with `qnt_purchases` and 3 other fields	High correlation
`recency_days` is highly correlated with `qnt_purchases`	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`tot_stock_code` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`freq_purchase` is highly correlated with `qnt_purchases` and 1 other fields	High correlation
`qtd_returned` is highly correlated with `qnt_purchases` and 3 other fields	High correlation
`freq_returns` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`avg_basket_variety` is highly correlated with `tot_stock_code` and 1 other fields	High correlation
`item_rp_ratio` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`net_margin` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`gross_revenue` is highly correlated with `qnt_purchases` and 1 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`tot_stock_code` is highly correlated with `avg_basket_variety`	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`avg_basket_variety` is highly correlated with `tot_stock_code`	High correlation
`item_rp_ratio` is highly correlated with `net_margin`	High correlation
`net_margin` is highly correlated with `item_rp_ratio`	High correlation
`gross_revenue` is highly correlated with `qnt_purchases` and 3 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`tot_stock_code` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`freq_purchase` is highly correlated with `qnt_purchases`	High correlation
`qtd_returned` is highly correlated with `freq_returns` and 2 other fields	High correlation
`freq_returns` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`avg_basket_variety` is highly correlated with `tot_stock_code`	High correlation
`item_rp_ratio` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`net_margin` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`df_index` is highly correlated with `customer_id` and 1 other fields	High correlation
`customer_id` is highly correlated with `df_index` and 1 other fields	High correlation
`gross_revenue` is highly correlated with `qnt_purchases` and 3 other fields	High correlation
`recency_days` is highly correlated with `df_index` and 1 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`tot_stock_code` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`avg_ticket` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`qtd_returned` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`avg_basket_size` is highly correlated with `avg_ticket` and 2 other fields	High correlation
`avg_basket_variety` is highly correlated with `tot_stock_code` and 1 other fields	High correlation
`item_rp_ratio` is highly correlated with `net_margin`	High correlation
`net_margin` is highly correlated with `avg_ticket` and 1 other fields	High correlation
`gross_revenue` is highly skewed (γ1 = 23.02670803)	Skewed
`qnt_items` is highly skewed (γ1 = 25.11648179)	Skewed
`avg_ticket` is highly skewed (γ1 = 48.21449998)	Skewed
`qtd_returned` is highly skewed (γ1 = 30.50367005)	Skewed
`df_index` is uniformly distributed	Uniform
`df_index` has unique values	Unique
`customer_id` has unique values	Unique
`qtd_returned` has 4200 (73.7%) zeros	Zeros
`freq_returns` has 4200 (73.7%) zeros	Zeros
`item_rp_ratio` has 4200 (73.7%) zeros	Zeros

Reproduction

Analysis started	2021-10-22 23:30:08.748377
Analysis finished	2021-10-22 23:30:29.991268
Duration	21.24 seconds
Software version	pandas-profiling v3.1.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

HIGH CORRELATION
UNIFORM
UNIQUE

Distinct	5701
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2898.856692

Minimum	0
Maximum	5791
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0
5-th percentile	290
Q1	1456
median	2901
Q3	4345
95-th percentile	5500
Maximum	5791
Range	5791
Interquartile range (IQR)	2889

Descriptive statistics

Standard deviation	1670.639329
Coefficient of variation (CV)	0.576309734
Kurtosis	-1.196215647
Mean	2898.856692
Median Absolute Deviation (MAD)	1445
Skewness	-0.003585702485
Sum	16526382
Variance	2791035.767
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
3850	1	< 0.1%
3870	1	< 0.1%
3869	1	< 0.1%
3868	1	< 0.1%
3867	1	< 0.1%
3866	1	< 0.1%
3865	1	< 0.1%
3864	1	< 0.1%
3863	1	< 0.1%
Other values (5691)	5691	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
5791	1	< 0.1%
5790	1	< 0.1%
5789	1	< 0.1%
5788	1	< 0.1%
5787	1	< 0.1%
5786	1	< 0.1%
5785	1	< 0.1%
5784	1	< 0.1%
5783	1	< 0.1%
5782	1	< 0.1%

customer_id
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct	5701
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	16603.65006

Minimum	12347
Maximum	22709
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	12347
5-th percentile	12700
Q1	14288
median	16229
Q3	18215
95-th percentile	21747
Maximum	22709
Range	10362
Interquartile range (IQR)	3927

Descriptive statistics

Standard deviation	2811.544204
Coefficient of variation (CV)	0.1693328993
Kurtosis	-0.8242992836
Mean	16603.65006
Median Absolute Deviation (MAD)	1964
Skewness	0.4409376168
Sum	94657409
Variance	7904780.81
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17850	1	< 0.1%
13461	1	< 0.1%
21092	1	< 0.1%
21091	1	< 0.1%
17123	1	< 0.1%
17891	1	< 0.1%
16498	1	< 0.1%
13745	1	< 0.1%
15584	1	< 0.1%
21089	1	< 0.1%
Other values (5691)	5691	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
12347	1	< 0.1%
12348	1	< 0.1%
12349	1	< 0.1%
12350	1	< 0.1%
12352	1	< 0.1%
12353	1	< 0.1%
12354	1	< 0.1%
12355	1	< 0.1%
12356	1	< 0.1%
12357	1	< 0.1%

Value	Count	Frequency (%)
22709	1	< 0.1%
22708	1	< 0.1%
22707	1	< 0.1%
22706	1	< 0.1%
22705	1	< 0.1%
22704	1	< 0.1%
22700	1	< 0.1%
22699	1	< 0.1%
22696	1	< 0.1%
22695	1	< 0.1%

gross_revenue
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	5457
Distinct (%)	95.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1759.775187

Minimum	0.42
Maximum	279138.02
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0.42
5-th percentile	13.3
Q1	237.07
median	612.78
Q3	1568.23
95-th percentile	5298.48
Maximum	279138.02
Range	279137.6
Interquartile range (IQR)	1331.16

Descriptive statistics

Standard deviation	7512.185767
Coefficient of variation (CV)	4.268832646
Kurtosis	698.9271054
Mean	1759.775187
Median Absolute Deviation (MAD)	478.3
Skewness	23.02670803
Sum	10032478.34
Variance	56432935
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
7.95	9	0.2%
1.25	8	0.1%
2.95	8	0.1%
4.95	8	0.1%
12.75	7	0.1%
1.65	7	0.1%
3.75	7	0.1%
7.5	6	0.1%
5.95	6	0.1%
4.25	6	0.1%
Other values (5447)	5629	98.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.42	1	< 0.1%
0.65	1	< 0.1%
0.79	1	< 0.1%
0.84	4	0.1%
0.85	3	0.1%
1.07	1	< 0.1%
1.25	8	0.1%
1.44	1	< 0.1%
1.65	7	0.1%
1.69	1	< 0.1%

Value	Count	Frequency (%)
279138.02	1	< 0.1%
259657.3	1	< 0.1%
194550.79	1	< 0.1%
140450.72	1	< 0.1%
124564.53	1	< 0.1%
117379.63	1	< 0.1%
91062.38	1	< 0.1%
72882.09	1	< 0.1%
66653.56	1	< 0.1%
65039.62	1	< 0.1%

recency_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	304
Distinct (%)	5.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	116.7938958

Minimum	0
Maximum	373
Zeros	37
Zeros (%)	0.6%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0
5-th percentile	3
Q1	23
median	71
Q3	199
95-th percentile	338
Maximum	373
Range	373
Interquartile range (IQR)	176

Descriptive statistics

Standard deviation	111.4937421
Coefficient of variation (CV)	0.9546196002
Kurtosis	-0.6361474179
Mean	116.7938958
Median Absolute Deviation (MAD)	61
Skewness	0.8161795168
Sum	665842
Variance	12430.85453
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	110	1.9%
4	105	1.8%
3	98	1.7%
2	92	1.6%
10	86	1.5%
8	82	1.4%
17	79	1.4%
9	79	1.4%
7	78	1.4%
15	67	1.2%
Other values (294)	4825	84.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	37	0.6%
1	110	1.9%
2	92	1.6%
3	98	1.7%
4	105	1.8%
5	52	0.9%
7	78	1.4%
8	82	1.4%
9	79	1.4%
10	86	1.5%

Value	Count	Frequency (%)
373	23	0.4%
372	22	0.4%
371	17	0.3%
369	4	0.1%
368	13	0.2%
367	16	0.3%
366	15	0.3%
365	19	0.3%
364	11	0.2%
362	7	0.1%

qnt_purchases
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	56
Distinct (%)	1.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.469566743

Minimum	1
Maximum	206
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	4
95-th percentile	11
Maximum	206
Range	205
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	6.80995105
Coefficient of variation (CV)	1.962766984
Kurtosis	302.3815489
Mean	3.469566743
Median Absolute Deviation (MAD)	0
Skewness	13.19904821
Sum	19780
Variance	46.3754333
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	2873	50.4%
2	828	14.5%
3	504	8.8%
4	394	6.9%
5	237	4.2%
6	173	3.0%
7	138	2.4%
8	98	1.7%
9	69	1.2%
10	55	1.0%
Other values (46)	332	5.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	2873	50.4%
2	828	14.5%
3	504	8.8%
4	394	6.9%
5	237	4.2%
6	173	3.0%
7	138	2.4%
8	98	1.7%
9	69	1.2%
10	55	1.0%

Value	Count	Frequency (%)
206	1	< 0.1%
199	1	< 0.1%
124	1	< 0.1%
97	1	< 0.1%
91	2	< 0.1%
86	1	< 0.1%
72	1	< 0.1%
62	2	< 0.1%
60	1	< 0.1%
57	1	< 0.1%

tot_stock_code
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	439
Distinct (%)	7.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	69.67251359

Minimum	1
Maximum	1786
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	13
median	36
Q3	84
95-th percentile	241
Maximum	1786
Range	1785
Interquartile range (IQR)	71

Descriptive statistics

Standard deviation	101.6752222
Coefficient of variation (CV)	1.459330472
Kurtosis	43.93242609
Mean	69.67251359
Median Absolute Deviation (MAD)	28
Skewness	4.706142862
Sum	397203
Variance	10337.8508
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	277	4.9%
2	149	2.6%
3	112	2.0%
10	101	1.8%
5	97	1.7%
9	96	1.7%
6	93	1.6%
8	93	1.6%
11	93	1.6%
7	90	1.6%
Other values (429)	4500	78.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	277	4.9%
2	149	2.6%
3	112	2.0%
4	90	1.6%
5	97	1.7%
6	93	1.6%
7	90	1.6%
8	93	1.6%
9	96	1.7%
10	101	1.8%

Value	Count	Frequency (%)
1786	1	< 0.1%
1766	1	< 0.1%
1322	1	< 0.1%
1118	1	< 0.1%
1109	1	< 0.1%
884	1	< 0.1%
817	1	< 0.1%
748	1	< 0.1%
730	1	< 0.1%
720	1	< 0.1%

qnt_items
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	1838
Distinct (%)	32.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	950.9510612

Minimum	1
Maximum	196844
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	1
5-th percentile	4
Q1	106
median	317
Q3	804
95-th percentile	2924
Maximum	196844
Range	196843
Interquartile range (IQR)	698

Descriptive statistics

Standard deviation	4187.017047
Coefficient of variation (CV)	4.402978469
Kurtosis	943.8119157
Mean	950.9510612
Median Absolute Deviation (MAD)	253
Skewness	25.11648179
Sum	5421372
Variance	17531111.76
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	113	2.0%
2	73	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
12	25	0.4%
88	22	0.4%
72	21	0.4%
7	20	0.4%
Other values (1828)	5263	92.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	113	2.0%
2	73	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
7	20	0.4%
8	18	0.3%
9	7	0.1%
10	17	0.3%

Value	Count	Frequency (%)
196844	1	< 0.1%
80263	1	< 0.1%
77373	1	< 0.1%
69993	1	< 0.1%
64549	1	< 0.1%
64124	1	< 0.1%
63312	1	< 0.1%
58343	1	< 0.1%
57885	1	< 0.1%
50255	1	< 0.1%

avg_ticket
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	5508
Distinct (%)	96.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	31.17621264

Minimum	0.42
Maximum	13305.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0.42
5-th percentile	3.461111111
Q1	7.95
median	15.85454545
Q3	21.96956522
95-th percentile	75.92857143
Maximum	13305.5
Range	13305.08
Interquartile range (IQR)	14.01956522

Descriptive statistics

Standard deviation	210.3688589
Coefficient of variation (CV)	6.74773621
Kurtosis	2853.27024
Mean	31.17621264
Median Absolute Deviation (MAD)	7.491045455
Skewness	48.21449998
Sum	177735.5883
Variance	44255.05681
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
3.75	11	0.2%
4.95	10	0.2%
2.95	9	0.2%
1.25	9	0.2%
7.95	8	0.1%
8.25	7	0.1%
12.75	7	0.1%
1.65	7	0.1%
5.95	6	0.1%
4.15	6	0.1%
Other values (5498)	5621	98.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.42	3	0.1%
0.535	1	< 0.1%
0.65	1	< 0.1%
0.79	1	< 0.1%
0.8371428571	1	< 0.1%
0.84	2	< 0.1%
0.85	3	0.1%
1.002222222	1	< 0.1%
1.02	1	< 0.1%
1.03875	1	< 0.1%

Value	Count	Frequency (%)
13305.5	1	< 0.1%
4453.43	1	< 0.1%
3861	1	< 0.1%
3202.92	1	< 0.1%
3096	1	< 0.1%
1687.2	1	< 0.1%
1377.077778	1	< 0.1%
1001.2	1	< 0.1%
952.9875	1	< 0.1%
931.5	1	< 0.1%

freq_purchase
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	1226
Distinct (%)	21.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.547443855

Minimum	0.005449591281
Maximum	17
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0.005449591281
5-th percentile	0.01104972376
Q1	0.025
median	1
Q3	1
95-th percentile	1
Maximum	17
Range	16.99455041
Interquartile range (IQR)	0.975

Descriptive statistics

Standard deviation	0.550492169
Coefficient of variation (CV)	1.005568268
Kurtosis	138.7489721
Mean	0.547443855
Median Absolute Deviation (MAD)	0
Skewness	4.849528892
Sum	3120.977417
Variance	0.3030416281
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	2881	50.5%
2	48	0.8%
0.0625	18	0.3%
0.02777777778	17	0.3%
0.02380952381	16	0.3%
0.08333333333	15	0.3%
0.03448275862	15	0.3%
0.09090909091	15	0.3%
0.02941176471	14	0.2%
0.03571428571	13	0.2%
Other values (1216)	2649	46.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.005449591281	1	< 0.1%
0.005464480874	1	< 0.1%
0.005479452055	1	< 0.1%
0.005494505495	1	< 0.1%
0.005586592179	2	< 0.1%
0.005602240896	1	< 0.1%
0.005617977528	2	< 0.1%
0.00566572238	1	< 0.1%
0.005681818182	2	< 0.1%
0.005698005698	3	0.1%

Value	Count	Frequency (%)
17	1	< 0.1%
4	1	< 0.1%
3	5	0.1%
2	48	0.8%
1.142857143	1	< 0.1%
1	2881	50.5%
0.75	1	< 0.1%
0.6666666667	3	0.1%
0.550802139	1	< 0.1%
0.5335120643	1	< 0.1%

qtd_returned
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED
ZEROS

Distinct	211
Distinct (%)	3.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	17.98561656

Minimum	0
Maximum	9014
Zeros	4200
Zeros (%)	73.7%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	38
Maximum	9014
Range	9014
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	204.483973
Coefficient of variation (CV)	11.36930571
Kurtosis	1147.978744
Mean	17.98561656
Median Absolute Deviation (MAD)	0
Skewness	30.50367005
Sum	102536
Variance	41813.69523
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4200	73.7%
1	169	3.0%
2	151	2.6%
3	105	1.8%
4	89	1.6%
6	78	1.4%
5	61	1.1%
12	52	0.9%
7	44	0.8%
8	43	0.8%
Other values (201)	709	12.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4200	73.7%
1	169	3.0%
2	151	2.6%
3	105	1.8%
4	89	1.6%
5	61	1.1%
6	78	1.4%
7	44	0.8%
8	43	0.8%
9	41	0.7%

Value	Count	Frequency (%)
9014	1	< 0.1%
8004	1	< 0.1%
4427	1	< 0.1%
3768	1	< 0.1%
3332	1	< 0.1%
2878	1	< 0.1%
2022	1	< 0.1%
2012	1	< 0.1%
1776	1	< 0.1%
1594	1	< 0.1%

freq_returns
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	428
Distinct (%)	7.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.1617817603

Minimum	0
Maximum	4
Zeros	4200
Zeros (%)	73.7%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.009950248756
95-th percentile	1
Maximum	4
Range	4
Interquartile range (IQR)	0.009950248756

Descriptive statistics

Standard deviation	0.3731179676
Coefficient of variation (CV)	2.306304288
Kurtosis	4.854269275
Mean	0.1617817603
Median Absolute Deviation (MAD)	0
Skewness	2.200043372
Sum	922.3178154
Variance	0.1392170177
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4200	73.7%
1	854	15.0%
2	14	0.2%
0.5	8	0.1%
0.2857142857	8	0.1%
0.02564102564	7	0.1%
0.25	6	0.1%
0.009478672986	5	0.1%
0.01960784314	5	0.1%
0.01298701299	5	0.1%
Other values (418)	589	10.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4200	73.7%
0.005571030641	1	< 0.1%
0.005681818182	2	< 0.1%
0.005865102639	1	< 0.1%
0.005934718101	1	< 0.1%
0.005952380952	1	< 0.1%
0.006024096386	1	< 0.1%
0.006042296073	1	< 0.1%
0.006172839506	1	< 0.1%
0.006191950464	1	< 0.1%

Value	Count	Frequency (%)
4	1	< 0.1%
3	1	< 0.1%
2	14	0.2%
1	854	15.0%
0.75	1	< 0.1%
0.6666666667	4	0.1%
0.5	8	0.1%
0.4285714286	1	< 0.1%
0.4	4	0.1%
0.3333333333	1	< 0.1%

avg_basket_size
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	2368
Distinct (%)	41.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	248.2129566

Minimum	1
Maximum	14149
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	1
5-th percentile	4
Q1	75
median	152
Q3	290.625
95-th percentile	732
Maximum	14149
Range	14148
Interquartile range (IQR)	215.625

Descriptive statistics

Standard deviation	439.2130469
Coefficient of variation (CV)	1.769500887
Kurtosis	379.1188261
Mean	248.2129566
Median Absolute Deviation (MAD)	96.5
Skewness	14.58135125
Sum	1415062.066
Variance	192908.1005
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	114	2.0%
2	72	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
12	26	0.5%
100	22	0.4%
72	22	0.4%
73	21	0.4%
Other values (2358)	5260	92.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	114	2.0%
2	72	1.3%
3	51	0.9%
3.333333333	1	< 0.1%
4	49	0.9%
5	35	0.6%
5.333333333	1	< 0.1%
5.666666667	1	< 0.1%
6	29	0.5%
6.142857143	1	< 0.1%

Value	Count	Frequency (%)
14149	1	< 0.1%
13956	1	< 0.1%
7824	1	< 0.1%
6009.333333	1	< 0.1%
5963	1	< 0.1%
5197	1	< 0.1%
4300	1	< 0.1%
4282	1	< 0.1%
4280	1	< 0.1%
4136	1	< 0.1%

avg_basket_variety
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1171
Distinct (%)	20.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	37.26967522

Minimum	0.2
Maximum	1109
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0.2
5-th percentile	1
Q1	7.285714286
median	15.11111111
Q3	31
95-th percentile	173
Maximum	1109
Range	1108.8
Interquartile range (IQR)	23.71428571

Descriptive statistics

Standard deviation	76.84283226
Coefficient of variation (CV)	2.061805792
Kurtosis	32.92217973
Mean	37.26967522
Median Absolute Deviation (MAD)	9.888888889
Skewness	5.075661182
Sum	212474.4185
Variance	5904.82087
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	276	4.8%
2	161	2.8%
3	115	2.0%
9	105	1.8%
10	105	1.8%
8	103	1.8%
7	101	1.8%
6	101	1.8%
5	100	1.8%
13	97	1.7%
Other values (1161)	4437	77.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.2	1	< 0.1%
0.25	3	0.1%
0.3333333333	7	0.1%
0.4	1	< 0.1%
0.4090909091	1	< 0.1%
0.5	12	0.2%
0.5454545455	1	< 0.1%
0.5555555556	1	< 0.1%
0.5714285714	1	< 0.1%
0.6176470588	1	< 0.1%

Value	Count	Frequency (%)
1109	1	< 0.1%
748	1	< 0.1%
730	1	< 0.1%
720	1	< 0.1%
703	1	< 0.1%
686	1	< 0.1%
675	1	< 0.1%
673	1	< 0.1%
660	1	< 0.1%
649	1	< 0.1%

item_rp_ratio
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	1379
Distinct (%)	24.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.01210009213

Minimum	0
Maximum	1
Zeros	4200
Zeros (%)	73.7%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.001038421599
95-th percentile	0.04109589041
Maximum	1
Range	1
Interquartile range (IQR)	0.001038421599

Descriptive statistics

Standard deviation	0.06503737724
Coefficient of variation (CV)	5.37494893
Kurtosis	132.4831683
Mean	0.01210009213
Median Absolute Deviation (MAD)	0
Skewness	10.46142317
Sum	68.98262522
Variance	0.004229860438
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4200	73.7%
1	11	0.2%
0.01075268817	4	0.1%
0.009661835749	4	0.1%
0.03225806452	3	0.1%
0.009259259259	3	0.1%
0.03846153846	3	0.1%
0.0243902439	3	0.1%
0.02380952381	3	0.1%
0.007462686567	3	0.1%
Other values (1369)	1464	25.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4200	73.7%
0.0001169636243	1	< 0.1%
0.0001839926403	1	< 0.1%
0.0002816901408	1	< 0.1%
0.0003140703518	1	< 0.1%
0.0003619254434	1	< 0.1%
0.0003632401017	1	< 0.1%
0.0003637686431	1	< 0.1%
0.0003671071953	1	< 0.1%
0.000393081761	1	< 0.1%

Value	Count	Frequency (%)
1	11	0.2%
0.9863013699	1	< 0.1%
0.8333333333	1	< 0.1%
0.6333333333	1	< 0.1%
0.6115107914	1	< 0.1%
0.6008836524	1	< 0.1%
0.5964566929	1	< 0.1%
0.5648854962	1	< 0.1%
0.5646387833	1	< 0.1%
0.5602040816	1	< 0.1%

net_margin
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1495
Distinct (%)	26.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.9849027449

Minimum	0
Maximum	1
Zeros	11
Zeros (%)	0.2%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0.9308852276
Q1	0.9979149666
median	1
Q3	1
95-th percentile	1
Maximum	1
Range	1
Interquartile range (IQR)	0.002085033385

Descriptive statistics

Standard deviation	0.06747936676
Coefficient of variation (CV)	0.06851373611
Kurtosis	117.1473911
Mean	0.9849027449
Median Absolute Deviation (MAD)	0
Skewness	-9.667344946
Sum	5614.930549
Variance	0.004553464938
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	3722	65.3%
1	224	3.9%
1	161	2.8%
1	93	1.6%
0	11	0.2%
0.9809727315	1	< 0.1%
0.9791926573	1	< 0.1%
0.9707212523	1	< 0.1%
0.9947665325	1	< 0.1%
0.9631287859	1	< 0.1%
Other values (1485)	1485	26.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	11	0.2%
0.04946653734	1	< 0.1%
0.1336898396	1	< 0.1%
0.1401705408	1	< 0.1%
0.2502340912	1	< 0.1%
0.2829510229	1	< 0.1%
0.324117991	1	< 0.1%
0.3548601864	1	< 0.1%
0.48	1	< 0.1%
0.483580072	1	< 0.1%

Value	Count	Frequency (%)
1	224	3.9%
1	3722	65.3%
1	161	2.8%
1	93	1.6%
0.9999180769	1	< 0.1%
0.9998431613	1	< 0.1%
0.9997243132	1	< 0.1%
0.9996916904	1	< 0.1%
0.9996728761	1	< 0.1%
0.9996149715	1	< 0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	df_index	customer_id	gross_revenue	recency_days	qnt_purchases	tot_stock_code	qnt_items	avg_ticket	freq_purchase	qtd_returned	freq_returns	avg_basket_size	avg_basket_variety	item_rp_ratio	net_margin
0	0	17850	5391.21	372.0	34.0	21.0	1733.0	18.152222	17.000000	40.0	1.000000	50.970588	0.617647	0.023081	0.980973
1	1	13047	3232.59	56.0	9.0	105.0	1390.0	18.904035	0.028302	35.0	0.023973	154.444444	11.666667	0.025180	0.955611
2	2	12583	6705.38	2.0	15.0	114.0	5028.0	28.902500	0.040323	50.0	0.105263	335.200000	7.600000	0.009944	0.988660
3	3	13748	948.25	95.0	5.0	24.0	439.0	33.866071	0.017921	0.0	0.000000	87.800000	4.800000	0.000000	1.000000
4	4	15100	876.00	333.0	3.0	1.0	80.0	292.000000	0.073171	22.0	0.078947	26.666667	0.333333	0.275000	0.725000
5	5	15291	4623.30	25.0	14.0	61.0	2102.0	45.326471	0.040115	29.0	0.032468	150.142857	4.357143	0.013796	0.984472
6	6	14688	5630.87	7.0	21.0	148.0	3621.0	17.219786	0.057221	399.0	0.019608	172.428571	7.047619	0.110191	0.907032
7	7	17809	5411.91	16.0	12.0	46.0	2057.0	88.719836	0.033520	41.0	0.013072	171.416667	3.833333	0.019932	0.987609
8	8	15311	60767.90	0.0	91.0	567.0	38194.0	25.543464	0.243316	474.0	0.072193	419.714286	6.230769	0.012410	0.977808
9	9	16098	2005.63	87.0	7.0	34.0	613.0	29.934776	0.024390	0.0	0.000000	87.571429	4.857143	0.000000	1.000000

Last rows

	df_index	customer_id	gross_revenue	recency_days	qnt_purchases	tot_stock_code	qnt_items	avg_ticket	freq_purchase	avg_basket_size	avg_basket_variety	net_margin
5691	5782	22700	4839.42	1.0	1.0	55.0	1074.0	78.055161	1.0	1074.0	55.0	1.0
5692	5783	13298	360.00	1.0	1.0	2.0	96.0	180.000000	1.0	96.0	2.0	1.0
5693	5784	14569	227.39	1.0	1.0	10.0	79.0	18.949167	1.0	79.0	10.0	1.0
5694	5785	22704	17.90	1.0	1.0	7.0	14.0	2.557143	1.0	14.0	7.0	1.0
5695	5786	22705	3.35	1.0	1.0	2.0	2.0	1.675000	1.0	2.0	2.0	1.0
5696	5787	22706	5699.00	1.0	1.0	634.0	1747.0	8.988959	1.0	1747.0	634.0	1.0
5697	5788	22707	6756.06	0.0	1.0	730.0	2010.0	9.254877	1.0	2010.0	730.0	1.0
5698	5789	22708	3217.20	0.0	1.0	56.0	654.0	54.528814	1.0	654.0	56.0	1.0
5699	5790	22709	3950.72	0.0	1.0	217.0	731.0	18.206083	1.0	731.0	217.0	1.0
5700	5791	12713	794.55	0.0	1.0	37.0	505.0	21.474324	1.0	505.0	37.0	1.0

Overview

Variables

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows